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^ (57) Abstract: A method of performing lawful interception of a multimedia call between two or more terminals. The method com- 
prises detecting the initiation of said call at monitoring equipment located in the call path, and forwarding from the monitoring 

O equipment to a gateway, parameters defining at least one of the forward and reverse channels of said call. At least one multimedia 
call is set up from said gateway to a monitoring terminal in dependence upon the received parameters. Following the setting up of 
the first mentioned multimedia call, forward and/or reverse channel data is intercepted at said monitoring equipment, the intercepted 
data routed to said gateway, and the data transmitted to the monitoring terminal over the forward channel of the or each second 
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Lawful Interception of Multimedia Calls 

Field of the Invention 

The present invention relates to the lawful interception of multimedia calls within a 
communications network. 

Background to the Invention 

The introduction of new communication systems including third generation mobile networks 
(3G) and broadband IP networks will result in a wide range of services being available to users. 
Not least amongst these services will be the possibility for multimedia (MM) calls between 
users, allowing video telephony and the exchange of data. 

There are circumstances in which authorised agencies such as the police and intelligence 
services must be able to monitor calls including multimedia calls. Such lawful interception is 
required in order to be able to collect information on those suspected of involvement in criminal 
or terrorist activities. The lawful interception of traditional voice call has been handled in two 
ways: 

1) The voice streams coming from the subscribers involved in a call to be intercepted are mixed 
together by monitoring equipment located in one of the "switches" involved in the call. The 
mixed stream is sent, by establishing an ancillary call, to the monitoring centre. Thus the mixed 
stream, i.e. the complete conversation between the parties, can be played for example using an 
ordinary loudspeaker in the monitoring centre. 

2) The voice streams coining from the subscribers involved in the intercepted call are not mixed, 
but rather two connections are established from the monitoring equipment to the monitoring 
centre, each carrying one leg of the call. This allows the monitoring centre to record the voices 
of the two call parties separately and/or mix the voice streams in the monitoring centre. 

The lawful interception of multimedia calls is more problematic than for voice calls. The 
protocols used to set up a multimedia call between terminals require handshaking between the 
participating terminals. The handshaking is used to agree upon parameters describing the 
payload of the call and how the payload is to be transported. The parameters to describe the 
payload include a used codec and codec options (e.g. video codecs such as H263 and MPEG4 
include a number of optional features, the main purpose of which are to either improve the 
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picture quality or decrease the used bandwidth, or both). Transport parameters include for 
example payload format, e.g. the format of the RTP-packet to be "used to carry a data stream in 
IP based transport network, or H223 logical channel parameters used in narrowband multimedia 
H.324. H223 logical channel parameters include parameters specifying whether payload frames 
5 are allowed to be segmented into several H223 multiplex frames, whether the payload frames 
are numbered, etc. 

Figure 1 illustrates for example a handshake between two terminals according to the ITU-T 
H.245 protocol (where "OLC" designates Open Logical Channel signaling messages). In the 

10 lawful interception scenario, it is not possible to involve the monitoring centre in the 
handshaking process as two terminals are already involved in the process and in any case it is 
undesirable to alert a terminal associated with a call to the interception action. For multimedia 
calls therefore, according to current interception processes, normal multimedia equipment (e.g. 
mobile handsets) cannot be used in the monitoring centre to decode and display the media. 

1 5 Interception can only be achieved using specialist equipment installed at the monitoring centre. 

Summary of the Invention 

According to a first aspect of the present invention there is provided a method of performing 
20 lawful interception of a multimedia call between two or more terminals, the method comprising: 

detecting the initiation of said call at monitoring equipment located in the call path; 

forwarding from the monitoring equipment to a gateway, parameters defining at least 
one of the forward and reverse channels of said call; 

setting up at least one multimedia call from said gateway to a monitoring terminal in 
25 dependence upon the received parameters; and 

following the setting up of the first mentioned multimedia call, intercepting forward 
and/or reverse channel data at said monitoring equipment, routing the intercepted data to said 
gateway, and transmitting the data to the monitoring terminal over the forward channel of the or 
each second mentioned multimedia call. 

30 

A main function of the gateway is to map, where necessary, protocols used in the network 
connecting the terminals involved in the call being intercepted, to protocols used in the network 
connecting the gateway to the monitoring terminal. These protocols include media control 
protocols (e.g. H.245), call control protocols (ISUP, H.225), multiplexing protocols (H.223), 
35 and audio and video codec protocols. 
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In one embodiment of the present invention, said terminals are H.324 terminals and a 
multimedia call is established between these terminals via circuit switched networks. The 
monitoring terminal is an H.323 or SIP terminal, and communicates with said gateway via a 
5 broadband IP network. 

Preferably, said monitoring equipment forwards to said gateway, signalling messages 
exchanged between the terminals involved in the call being intercepted. The gateway uses the 
information contained in these messages to setup the multimedia call(s) to the monitoring 
10 terminal and/or to setup transcoding functions within the gateway. The need for transcoding is 
determined primarily by the properties of the monitoring terminal, as well as the properties of 
the gateway. 

The method may comprise setting up a call from said gateway to the monitoring terminal for 
15 each of the forward and reverse channels of the intercepted call. Alternatively, the forward and 
reverse channels data may be multiplexed/mixed onto the forward channel of a single call 
established between said gateway and the monitoring terminal. In another alternative, two calls 
may be established between the gateway and respective terminals at the monitoring centre. 
Forward channel data from the intercepted call is placed on the forward channel of one of these 
20 two calls, whilst reverse channel data is placed on the forward channel of the other one of the 
calls. 

According to a second aspect of the present invention there is provided apparatus for 
intercepting a multimedia call between two or more terminals, the apparatus comprising: 
25 means for receiving from monitoring equipment located within the call path, parameters 

defining at least one of the forward and reverse channels of said call, following detection of the 
initiation of said call by the monitoring equipment; 

means for setting up at least one multimedia call to a monitoring terminal; and 
means for receiving intercepted forward and/or reverse channel data from said 
30 monitoring equipment, and for transmitting the data to a monitoring terminal over the forward 
channel(s) of the second mentioned multimedia call(s). 

Brief Description of the Drawings 
35 Figure 1 illustrates handshake signalling between two H.324 terminals; 
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Figure 2 illustrates schematically a Video Interactive Gateway providing an interface between 
H.324 and H.323 domains; 

Figure 3 illustrates the use a Lawful Interception Gateway to intercept two calls between H.324 
terminals; 

5 Figure 4 shows in detail signalling between two H324 terminals, and between a Lawful 
Interception Gateway and an H.323 monitoring terminal; 

Figure 5 shows signalling between two SEP terminals, and between a Lawful Interception 
Gateway and a SIP monitoring terminal; and 

Figure 6 illustrates network nodes involved in lawful interception where calls are set up using 
10 SIP. 

Detailed Description of a Preferred Embodiment 

The following standards will be referred to inter alia in this description of a preferred 
1 5 embodiment of the present invention: 

ITU-T H.323 Packet based multimedia communications systems; 

ITU-T H.324 Terminal for low bit-rate multimedia communication; 

ITU-T H.223 Multiplex protocol for low bit rate multimedia communication; 

ITU-T H.245 Control protocol for multimedia communication; 

20 3GPPTS 24.228 Signalling flows for the IP multimedia call control based on SIP and 

SDP; 

3GPP TS 33.108 Handover interface for lawful interception. 

By way of explanation, there is now provided a general outline of the various protocols used to 
25 establish and control multimedia calls, and of the protocols defining multimedia data types. 
There will then be provided a description of an embodiment of the invention which provides for 
the lawful interception of multimedia calls. 



Multimedia calls can be divided into two categories: multimedia calls using narrowband circuit 
30 connections and multimedia calls using an IP (broadband) network. 

In the case of multimedia calls transported over narrowband circuit connections, a known 
protocol is ITU-T H.324. H.324 uses a mechanism in which different multimedia components 
are multiplexed into a single data stream, which is transported over the circuit connection. 
35 H.223 is used by H.324 as a multiplexing protocol, to multiplex different data streams from 
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different media codecs (e.g. G.723, AMR for audio, and H.263, MPEG4 for video) and the 
media control protocol (H.245) into a single data stream. The circuit switched call itself might 
typically be established using ISUP. 

5 In the case of multimedia calls transported over an IP-network, known protocols in this category 
for establishing and controlling calls are H.323 and Session Initiation Protocol (SIP). The 
fundamental mechanism for these two protocols is the same. The media control protocol is 
transported via a TCP/IP (or SCTP/IP) connection between terminals. The media streams are 
transported by using separate RTP/IP connections for each media between the terminals. H.323 
10 uses H.225 to set up connections between H.323 terminals. 

Interworking between these two categories of multimedia calls is generally achieved by using a 
so-called Video Interactive Gateway (VIG) which makes possible interworking between low 
bit-rate multimedia terminals (H.324) located in circuit switched telephony networks and 

15 terminals in IP based multimedia systems (H.323/SIP). The circuit switched networks may use 
the 64 kbit/s unrestricted digital bearer for the multimedia connection. Using H.223 as the 
multiplexing protocol, different multimedia components (audio, video and data) are multiplexed 
within the circuit switched bearer. These channels are de-multiplexed by the VIG onto separate 
RTP and TCP channels in the IP network, and vice versa. VIG may perform transcoding for 

20 different multimedia components if necessary in order to make communication between end 
terminals possible. 

H.245 may be used as a control protocol both in circuit switched networks and in IP networks, 
providing end-to-end capability exchange, signalling of command and indications, and 
25 messages to open and describe the content of logical channels for different multimedia 
components. The VIG performs mapping of H.245 messages between a circuit switched 
network and an IP network, in order to adapt the different transport protocols and to enable 
transcoding of media channels. The VIG will perform mapping if necessary between the call 
control protocol in the circuit switched network (ISUP), and that in the IP network (H.225). 

30 

Figure 2 illustrates schematically a VIG interfacing H.324 and H.323 networks. The VIG 
comprises a Media Gateway operating at the bearer level and providing interworking between 
user data, and a Media Gateway Controller operating at the call control level and providing 
interworking between signalling protocols. 
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It must be possible to carry out the lawful interception of calls between terminals regardless of 
the protocols used between the terminals. However, this should be possible using some 
standard piece of equipment on the part of the intercepting authority, i.e. it is not desirable to 



5 or not a VIG is present in a call path. 

Figure 3 shows an example lawful interception scenario for a call between two mobile terminals 
(A and B) having narrowband access (e.g. via a 3G network), both terminals being H.324 
terminals. Monitoring equipment (this essentially being equipment for placing a "tap" on both 

10 legs of a call) is located within an MSC of the GSM network. A Lawful Interception Gateway 
(LIG) provides a gateway between the monitoring equipment and a monitoring centre. The 
monitoring centre comprises an H.323 terminal coupled to the LIG via a broadband IP network. 
In a typical scenario, the H.323 terminal at the monitoring centre is implemented on a standard 
Personal Computer (PC): Whilst the PC might use, for example, Microsoft Netmeeting™ to 

15 establish calls with the LIG, the LIG would typically use a proprietary solution for this purpose. 

The LIG acts as a VIG (see Figure 2), translating data between the narrowband and broadband 
formats. The functions performed by the LIG are as follows: 



have to select equipment depending upon the protocols used between callers and upon whether 



• The LIG listens to the incoming data streams from the monitoring equipment. 



20 



• It decodes the transport/multiplex protocols (e.g. H.223) 



• The LIG decodes the relevant information from the media control protocol, i.e. codec 
information within the Session Description Protocol (SDP) in case where SIP is used in 
the broadband network, and codec information and other information (e.g. H.223 
logical channel parameters within H.245 in case of H.323). 



25 



• The LIG establishes a connection to a normal multimedia terminal in the monitoring 



centre based on the received information. 



• The LIG emulates a normal multimedia terminal towards the normal multimedia 



30 



terminal within the monitoring centre, by performing the complete media control 
protocol transactions with that terminal. This includes: 1) invoking the required 
procedures to connect the media streams for the data coming from the monitoring 
equipment, and 2) responding correctly to the procedure invocations coming from the 
terminal in the monitoring centre. 



• The LIG forwards the media streams coming from the monitoring equipment,, over the 
established connections to the monitoring centre. 



35 
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Figure 4 illustrates signalling exchanges between the H.324 terminals A and B. In order to set 
up a call between the two terminals, a terminal capabilities exchange procedure (or handshake) 
is performed. The results of this negotiation are confirmed by terminal A to terminal B in an 
OLC (Forward Channel Description, Reverse Channel Description) message. The MSC in 
5 which the monitoring equipment is located maintains or has access to a database of subscribers 
for whom lawful interception warrants have been served. When a MM call is initiated to. or 
from a subscriber on whom such an order has been placed, the MSC notifies the LIG. The MSC 
then forwards to the LIG the entire (64kbit/s) multiplexed streams, in both the forward and 
reverse directions, including the OLC (Forward Channel Description, Reverse Channel 
10 Description) message sent from terminal A to terminal B. 

The LIG examines the parameters of the two legs of the call, and initiates two calls to the H.323 
terminal at the monitoring centre. The properties of the forward channel (i.e. which will carry 
data from the LIG to the monitoring centre) of the first call correspond to the properties of the 
15 forward channel of the call between terminals A and B. The properties of the forward channel 
of the second call correspond to the properties of the reverse channel of the call between 
terminals A and B. The properties of the reverse channels of the two calls between the LIG and 
the H.323 terminal are irrelevant as these channels will not be used to caiTy "live" data. 

20 An assumption here is that the H.323 terminal at the monitoring centre is able to terminate two 
calls simultaneously, arid therefore that the forward and reverse channels of the intercepted call 
can be carried on respective calls to that H.323 terminal. An alternative mechanism is for the 
LIG to establish calls to two different H.323 terminals at the monitoring centre, or for a single 
call to be established with the forward and reverse channel data being multiplexed/mixed onto 

25 that single call. An appropriate mechanism may be selected by the LIG based upon a terminal 
capabilities negotiation with the H.323 terminal. 

The LIG may include transcoding capabilities, which makes it possible to use multimedia 
terminals in the monitoring centre which do not support all possible codecs. 

30 

Figure 5 illustrates signaling in a scenario where the terminal used at the monitoring centre 
utilises SIP signaling to establish calls over a broadband IP network to which the LIG is also 
attached, and in which the two terminal participating., in the intercepted call also use SIP 
signaling. Again, following notification of (forward and reverse channel) parameters by the 
35 monitoring equipment at the MSC, the LIG establishes two calls to the SIP terminal at the 
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monitoring centre. It will be appreciated that in this embodiment of the invention the LIG does 
not provide any VIG functionality. 

Figure 6 illustrates in more detail the interception procedure. Within the IP multimedia 
subsystem (IMS), a Proxy CSCF (P-CSCF) participates in SIP signalling. The P-CSCF 
may be located either in a participating terminal's home network or in a visited network 
to which that terminal is attached. The P-CSCF identifies the SEP-URL(s) to which SIP 
signalling belongs. The P-CSCF also has a knowledge of SIP-URLs for which calls are 
to be intercepted. Using this information, the P-CSCF forwards SIP signalling 
associated with a call to be intercepted to the LIG as shown in Figure 5 (the LIG is 
implemented as part of the Delivery Function (DF)). The P-CSCF commands the 
GPRS Gateway Support Node (GGSN) to make a copy of RTP-stream (media streams) 
and forward them it to the LIG. In Figure 6, the monitoring terminal corresponds to the 
LEMF node, the latter being 3 GPP terminology. According to 3 GPP, the H3 and H2 
interfaces carry user and signalling data respectively from the interception node to the 
monitoring terminal. According to the present invention, these interfaces are "merged" 
into one or more multimedia calls. 

It will be appreciated by the person of skill in the art that various modifications may be made to 
the above described embodiment. For example, the LI subscriber database available to the 
MSG may define for subscribers on whom an interception warrant has been place, whether the 
reverse and forward channels are to be intercepted, or whether only one of these channels is to 
be intercepted. This information is signaled to the LIG. 

Whilst in the scenario described with reference to Figure 3 the terminals A and B are H.324 
terminals whilst the intercepting terminal is an H. 3 23 terminal, other scenarios are possible. 
These include: 

1. A and B terminals are H.324 terminals. The monitoring centre has an H323 terminal. 
The LIG performs H245-H245 mapping between two half calls and two complete calls. 
The LIG also performs TDM/H223 to IP/RTP interworking. 

2. A and B terminals are H324 terminals. The monitoring centre has an H324 terminal; 
The LIG performs H245-H245 mapping between two half calls and two complete calls. 
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3. A and B terminals are H324 terminals. The monitoring centre has a SIP terminal. The 
LIG performs H245-SD? mapping between two half calls and two complete calls. The 
LIG also performs TDM/H223 to IP/RTP interworking. 

4. A and B terminals are SIP terminals. The monitoring centre has an H323 terminal. The 
LIG performs SIP-H245 mapping between two half calls and two complete calls. 

5. A and B terminals are SIP terminals. The monitoring centre has an H324 
terminal. The LIG performs SIP-H245 mapping between two half calls and two 
complete calls. The LIG also performs TDM/H223 to IP/RTP interworking. 

6. A and B terminals are SIP terminals. The monitoring centre has a SIP terminal. 
The LIG performs SIP-SIP mapping between two half calls and two complete 
calls. 

In the SIP embodiment of Figure 5, it might sometimes be the case tihat intercepted data does 
not need conversion/transcoding at the LI gateway. In that case, the P-CSCF might instruct the 
GGSN to forward intercepted data directly to the monitoring terminal. No multimedia call need 
be established between the LI gateway and the monitoring terminal. 
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1. A method of perforating lawful interception of a multimedia call between two or more 
terminals, the method comprising: 
5 detecting the initiation of said call at monitoring equipment located in the call path; 

forwarding from the monitoring equipment to a gateway, parameters defining at least 
one of the forward and reverse channels of said call; 

setting up at least one multimedia call from said gateway to a monitoring terminal in 
dependence upon the received parameters; and 
10 following the setting up of the first mentioned multimedia call, intercepting forward 

and/or reverse channel data at said monitoring equipment, routing the intercepted data to said 
gateway, and transmitting the data to the monitoring terminal over the forward channel of the or 
each second mentioned multimedia call. 

15 2. A method according to claim 1, said gateway performing a mapping between protocols 
used in the network connecting the terminals involved in the call being intercepted, to protocols 
used in the network connecting the gateway to the monitoring terminal. 

3. A method according to claim 1 or 2, wherein the monitoring terminal communicates 
20 with said gateway via a broadband IP network. 

4. A method according to any one of the preceding claims, said monitoring equipment 
forwarding to said gateway, signalling messages exchanged between the terminals involved in 
the call being intercepted. 

25 

5. A method according to any one of the preceding claims, said gateway performing 
transcoding of intercepted channel data. 

6. A method according to any one of the preceding claims and comprising setting up a call 
30 from said gateway to the monitoring terminal for each of the forward and reverse channels of 

the intercepted call. 

7. A method according to any one of claims 1 to 5 and comprising multiplexing/mixing 
the intercepted forward and reverse channel data onto the forward channel of a single call 

35 established between said gateway and the monitoring terminal. 
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8. A method according to any one of claims 1 to 5 and comprising establishing two calls 
between the gateway and respective terminals at the monitoring centre, forward channel data 
from the intercepted call being placed on the forward channel of one of these two calls, whilst 

5 reverse channel data is placed on the forward channel of the other one of the calls. 

9. A method according to any one of the preceding claims, wherein the terminals 
participating in the first mentioned multimedia call are H.324 terminals, and said monitoring 
terminal is an H.323 terminal. 

10 

10. A method according to any one of claims 1 to 8, wherein the terminals participating in 
the first mentioned multimedia call are SIP terminals, and said monitoring terminal is also a SEP 
terminal 

15 11. Apparatus for intercepting a multimedia call between two or more terminals, the 
apparatus comprising: 

means for receiving from monitoring equipment located within the call path, parameters 
defining at least one of the forward and reverse channels of said call, following detection of the 
initiation of said call by the monitoring equipment; 
20 means for setting up at least one multimedia call to a monitoring terminal; and 

means for receiving intercepted forward and/or reverse channel data from said 
monitoring equipment, and for transmitting the data to a monitoring terminal over the forward 
channel(s) of the second mentioned multimedia call(s). 



25 
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